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Abstract. A general simplicity problem in category theory is proposed. A 
particular example, the simplest choice of generators of an algebra is specified 
and illustrated by an example. 

The idea of physics and of some of mathematics may be seen as the expansion and 
compression of information about the real world or, better, of our understanding 
of the real world: The understanding has to be correct and simple. 

But what is the correct judgement on simplicity? A vague maximum principle, 
Occam's razor is not always well formalized. As a concept, a measure of simplicity 
is at hand: The simpler the thing, the less information is needed to describe it and 
there is an accepted measure of information, entropy. This runs however into at 
least two problems: 

(1) To understand the information, a context is needed. Is the background in- 
formation contained in the context also to be measured? Here we solve this 
by clearly specifying what structure is considered background information 
and what additional information is measured. 

(2) A simple-minded evaluation of entropy leads in cases involving infinite sets 
or continuous parameters to infinities. In order to avoid a technically de- 
manding analysis, we count here the number of continuous parameters to 
be specified, discounting data given by finite natural numbers. At the same 
time we force the number of parameters to be finite. 

The outline of the paper is the following: Section ^ measures the information of 
an object in an abelian category against a background knowledge category. Section 
|2] specifies to the case of algebras and sets. An explicit result of Proposition 
^ provides an instance of solving the general problem. A summary is given in the 
Conclusion. 

1. The simplicity of free resolutions 

The proposal of this section is to measure the information content of a suitable 
mathematical structure in an abelian category according to the following principles: 

• There is a category A and an abelian category B linked by a forgetful 
functor U : B — > A and by a free functor F : A — ► B, the adjoint of U. 
The objects of interest reside in category B while category A specifies the 
background information. 

• The functors U , F are part of the background information. Their applica- 
tion is not considered as connected to the provision of additional informa- 
tion. 

• The information content of an object b of the category B to be measured 
is the information that needs to be added to Ub in order to understand the 
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structure of b. This is provided in the form of a free resolution of b. A free 
resolution [2] is then given by the following diagram: 

(1) —h. Fa 3 Fa 2 ^Fa.^b 

23 22 11 

a 3 a 2 ai 

where the upper row is exact. The vertical arrows indicate the functor 
F, the mappings i, should be correctly interpreted as the inclusions of 
generators i, : a m — > UFa,. 

According to these rules, the information contained in the object b of the category 
B with respect to the background knowledge category A is contained in the maps 

(2) Uf k oi k :a k ^UFa k -i for k e {2, 3, 4, ...} 

However, these maps do not need to be specified entirely: There may be automor- 
phisms of the lower row of the resolution @ and respecting the grading of the 
resolution that lift to automorphisms of the upper row. Such automorphisms will 
be called Bogoliubov automorphisms and determine the freedom in the maps (J5J) 
that does not affect the free resolution and does therefore not need to be spec- 
ified. Now, different free resolutions of b will have different information contents 
and it is natural to assign to b the lowest possible information content attainable 
by a free resolution. 

We may rephrase this by saying that the information content of b is the infor- 
mation contained in its simplest object a\ of generators (included in b via the map 
U fi o ii : a\ — > Ub) together with its relations as given by the free resolution (JjJJ 

Thus, the information to be measured is the information contained in the maps 
J2J up to Bogoliubov transformations. 

That this can be indeed done is shown in an example of the following section. 

2. Finite free resolutions of algebras and their information content 

2.1. Finite free resolutions. Let A be the category of vector spaces and B the 
category of C*-algebras. Let b be a finite dimensional C*-algebra. Then a linear 
(grading preserving) transformation transformation in the lower row of Q can only 
be lifted to an algebra automorphism in the upper row if it maps generators into 
generators with the same spectrum. This is obviously not always the case, for any 
linear transformation of the lower row of generators of ©. 

It is now possible to enquire into how much information is contained in a given set 
of generators or, in other words, in a given free resolution of the object 6, an algebra. 
Unfortunately, the simple idea of just counting, whatever information there is and 
arriving at a quantitative result is hindered by the appearance of infinities which 
have to be dealt with properly. To avoid such technically demanding problems, we 
will restrict ourselves to finite dimensional algebras and to finite resolutions only. 

Definition 1. A free resolution © of an algebra is called here a finite free resolution 
if 

(1) there is only a finite number N of nonzero terms Fa\, Fa 2 , . . . , Fcln in the 
resolution, 

(2) the dimensions dj of the vector spaces a,j are all finite, 
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(3) the maps fj o ij : aj — > Fdj-i, j = 2, 3,4, . . . send eij into a subspace of 
Fa,j-i of finite degree dj-i of the filtration of Fdj-i by word length. 

Remark 1. While the first two conditions of the definition of a finite free resolu- 
tion are entirely straightforward, the last, third condititon deserves some further 
justification. The maps fi which are an essential part of the free resolution are 
uniquely determined by the maps fj o ij : a,j — > Faj—\, j = 2,3,4, .. . and the 
information contained in them is to be included into the information contained in 
the free resolution. In fact, this is the dominant information content of the resolu- 
tion. Unless a.j-i is of dimension = 0, the free algebra Fdj—i is necessarily 
infinite dimensional, spanned as a linear space by (finite) words with letters being 
elements in aj and is canonically a filtered algebra. The linear subspaces T n Faj-\ 
of this filtration of the free algebra Faj-i are spanned by words containing at most 
n letters. 

That the range of fj o ij : a,j — > Faj—i is inside is a finite subspace J-g j _ 1 Faj^i 
is a simple consequence of the finite dimension dj of aj and of the fact that only 
finite sums of words are contained in Fdj-x- Thus the third requirement is not 
restrictive but rather serves to define the numbers dj and to emphasise that infinite 
series are not included in the resolution. 

A restatement of this may be that all relations (relations of relations, ...) of 
the resolution ought to be generated from finite polynomial relations (relations of 
relations, ...). 

2.2. The information content of a finite free resolution. To summarize, a 
finite free resolution is given by the following data: 

• a number N giving the length of the resolution, 

• the numbers d\ , . . . , dpf giving the dimensions of the vector spaces a±, . . . , , 

• the grading numbers d\, . . . , 9jv-i 5 

• the algebra homomorphisms f\ , . . . , /jv determined uniquely by the linear 
maps 

(3) f 2 o i 2 : a 2 -> T dl Fai 

(4) h ° «3 : a 3 —> Fd2 Fa 2 

(5) fi o i 4 : a 4 -> T a3 Fa 3 



(6) /jv o i N : o/v — > Tg N _ 1 Fa N ^i 

In agreement with p^, the entropy of a natural number N will be taken to be 

(7) S N = \nN, 

and the entropy of all numbers in the data of a finite free resolution is just the sum 
of the entropies of all numbers: 

Af N-l 

(8) S num bers = In TV + ^ In dj + In dj . 

i=i 3=1 

It remains now to find the entropy of the maps /jv ° In '■ a j —* Fd N -iFa,N-i 
modulo Bogoljubov automorphisms. That is the essential part of the entropy cal- 
culation, since specifying these maps requires to determine real parameters. These 
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contain an infinite number of digits and carry therefore an infinite entropy against 
which one typically can neglect Snumbers ■ Thus the minimalization of required in- 
formation boils down to finding the set of maps ©-© containing up to Bogoliubov 
automorphisms the least number of continuous parameter specifications. 

This problem has been solved in |3] for the case of b being the algebra M2(C) 
of 2 x 2-matrices with complex numbers in its entries. The solution is found to be 
the Clifford resolution of M 2 (C): 

Definition 2. Let M 2 m(C) be the algebra of 2 rn x 2 m -matrices. Its Clifford 
resolution is the following finite free resolution: 

(9) >■ Fa 2 Fax ^ M 2 m (C) 

22 ii 
V m (2m+1) V 2m 

Where Vi m is the 2m-dimensional complex vector space of generators with a basis 
ex, e 2l e 2m and where V m {2m+i) is the m(2m + l)-dimensional complex vector 
space of relations with a basis r±<i, r\< 2 , r 2m < 2m mapped by f 2 ° i 2 onto the 
relations 

(10) f 2 o i 2 rk<i = efcej + e;efc - Ski for k, I € {1, 2, 2m} and k < I 

Proposition 1. The finite free resolution of the matrix algebra M 2 (C) with the 
least number of parameters to be specified is given by the Clifford resolution. 

For the convenience of the reader we provide the following 

Proof. Since the algebra M 2 (C) is noncommutative, its subspace of generators has 
to be at least 2-dimensional. 

The word length of relations has to be at least 2, again to avoid commutativity. 

The algebra M 2 (C) is 4-dimensional, with the 2-dimensional set of generators 
and the unit being linearly independent, leaving thus one dimension for one linearly 
independent linear combination of four words of length 2. Thus at least 3 relations 
are required. 

The Clifford resolution allows for a 1-dimensional Bogoliubov automorphism. 
This can be checked to be the maximal dimension for any possible Bogoliubov 
automorphism. □ 

3. Conclusion 

The general proposal of Section ^ to measure information content of the object 
of a category through its simplest free resolution against a category of background 
knowledge was specified in Section [21 for the case of C*-algebras and their linear 
subspaces of generators. In the simplest case of 2 x 2-matrices, the simplest finite 
free resolution is known [3]. That result adds as an example on substance to the 
general framework explained here and poses at the same time the challenge of more 
such examples. 

Note that the simplest finite free resolution is of interest not just as a tool to 
measure information but also for providing a suitable set of generators well adapted 
to the algebra in question. 

The case of n x n-matrices will be discussed in further work of one of the authors 
(R. Otahalova). 
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